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The Local Search problem, which finds a local minimum of a black-box function on a given 
graph, is of both practical and theoretical importance to many areas in computer science and 
natural sciences. In this paper, we show that for the Boolean hypercube {0, 1}™, the randomized 
query complexity of Local Search is 8(2"/ 2 n 1 / 2 ) and the quantum query complexity is 8(2™/ 3 n 1 / 6 ). 
We also show that for the constant dimensional grid [N 1 / d ] d : the randomized query complexity is 
9(A f1 / 2 ) for d > 4 and the quantum query complexity is 9(iV 1 / 3 ) for d > 6. New lower bounds 
■ for lower dimensional grids are also given. These improve the previous results by Aaronson [2], and 

[ Santha and Szegedy|2ni- Finally we show for [A 1 / 2 ] 2 a new upper bound of 0(N 1 / 4 (log log ^V) 2 ) on 

the quantum query complexity, which implies that Local Search on grids exhibits different properties 
, at low dimensions. 

^ ! 1 Introduction 



Many important combinatorial optimization problems arising in both theory and practice are NP- 
hard, which forces people to resort to heuristic searches in practice. One popular approach is local 
search, in which one first defines a neighborhood structure, then finds a solution that is locally 
optimal with respect to this neighborhood structure. In the past two decades, the local search 
approach has been extensively developed and "has reinforced its position as a standard approach 
in combinatorial optimization" in practice pp. Besides the practical applications, local search also 
has many connections to the complexity theory, especially to the complexity classes PLS 1 and 
TFNP 2 . For example, the 2SAT-FLIP problem, an important problem known to be complete 
in PLS, is actually the local search problem with the neighborhood structure being the Boolean 
hypercube {0, 1}" and the objective function being the sum of the weights of the clauses that the 
truth assignment x £ {0, 1}" satisfies. Local search is also related to physical systems including 
folding proteins and to the quantum adiabatic algorithms We refer readers to the papers 
El EH] for more discussions and the book [Hj for a comprehensive introduction. 

Precisely, the Local Search problem on an undirected graph G = (V, E) is defined as follows. 
Given a function / : V —* N, find a vertex v S V such that f(v) < f(w) for all neighbors w of v. 
A class of generic algorithms that has been widely used is as follows: first set out with an initial 
point v G V , then repeatedly search the neighbors to find a point with a smaller / value until it 
reaches a locally optimal one. Though empirically this class of algorithms work very well in most 
applications, relatively few theoretical results are known about how good the generic algorithms are, 
especially for the randomized (and quantum) algorithms. This paper investigates the Local Search 
on some natural neighborhood structures G, and proves the optimality of the generic algorithms for 
most G's. For some other G, we give an algorithm better than the generic ones. 

Among models for the theoretical studies, the query model has drawn much attention [3 El 
El El EDI- In this model, f(v) can only be accessed by querying v, and the randomized (and 

"This research was supported in part by NSF grants CCR-0310466 and CCF-0426582. 
^Computer Science Department, Princeton University, NJ 08544, USA. Email: szhang@cs.princeton.edu 
Polynomial Local Search, introduced by Johnson, Papadimitriou, and Yannakakis |14j . 
2 The family of total function problems, introduced by Megiddo and Papadimitriou |18|. 
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quantum) query complexity, denote by RLS{G) (and QLS(G)) is the minimum number of queries 
needed by a randomized (and quantum) algorithm that solves the problem. Previously, for upper 
bounds on a general TV-vertex graph G, Aldous @] proved that RLS(G) = 0(V N8) and Aaronson 
proved that QLS(G) = O^^S 1 ? 6 ), where 5 is the maximum degree of G. Both algorithms are 
actually the generic algorithms mentioned above, with the initial point picked as the one having 
the minimum / value over some random samples. For lower bounds, Aaronson [2] considered two 
special classes of graphs: the Boolean hypercube {0, l} n and the constant dimensional grid [N 1 ^ d ] d . 
He showed that for {0, 1}", RLS({0, 1}™) = Q{2 n / 2 /n 2 ) and QLS({0, I}™) = f2(2 n / 4 /n), and that 
for [N^ d ] d , RLS([NV d ] d ) = Q(N 1 / 2 ~ 1 / d /logN) and QLS([N 1 / d } d ) = niN 1 / 4 ' 1 /^ /^/TogN). It 
has also been shown that QLS^N 1 / 2 ] 2 ) = ^(/V 1 / 8 ) by Santha and Szegedy |2Dj. However, the final 
values of QLS and RLS on both types of special graphs remain an open problem, explicitly stated 
in an earlier version of [2] and also (partially) in [20J ■ 

In this paper, we improve these previous results and show tight bounds on both RLS and QLS 
in a unified framework. For the Boolean hypercube, our lower bounds match the known upper 
bounds [22]. For the constant dimensional grid graphs, our lower bounds also match the known 
upper bounds except for a few low dimensional cases. These imply that the generic algorithms [210] 
are the best for all these neighborhood structures. 

Theorem 1 RLS({0, 1}™) = n{2 n / 2 n 1 ' 2 ), QLS({0, 1}") = Q(2"/ 3 nV 6 ). 
Theorem 2 

(niN 1 / 2 ) ifd>4 fjXAT 1 / 3 ) ifd>6 

RLS([N^ d ] d ) = i n((JV/log/V)V2) ifd = 3, QLS([N^ d ] d ) = ^((/V/log/V) 1 / 3 ) ifd = 5 

[q(N 1 / 3 ) ifd=2 [SI (JVV2-V(<i+i)) if2<d<4 

The proofs for the quantum lower bounds in both theorems use the quantum adversary method, 
which was originally proposed by Ambainis 0, and later generalized in different ways [rfll%l ll5l I22| . 
Recently Spalek and Szegedy made the picture clear by showing that all these generalizations are 
equivalent in power |21) . On the other hand, in proving a particular problem, some of the methods 
might be easier to use than the others. In our case, the technique proposed by Zhang |22| works 
pretty well. 

Inspired by the quantum adversary method, Aaronson gave a technique called relational ad- 
versary method, to prove lower bounds of randomized query complexity [2J. Our proofs for the 
randomized lower bounds will use this method. 

Both the quantum adversary method and the relational adversary method are frameworks of 
proving lower bounds, parameterized by input sets and weight functions of input pairs. Both our 
proofs and Aaronson's proofs [2] use random walks in the corresponding graphs to give the input 
sets and weight functions. Besides choosing different random walks and different weight functions, 
a key innovation that distinguishes our work from Aaronson's is that we decompose the graph into 
two parts, the tensor product of which is the original graph. We perform the random walk only in 
one part, and perform a simple one-way walk in a self- avoiding path in the other part, which serves 
as a "clock" to record the number of steps taken by the random walk in the first part. The tensor 
product of these two walks is a random path in the original graph. A big advantage of adding a clock 
is that the "passing probability" , the probability that the random path passes a vertex v within T 
steps, is now the "stopping probability" , the probability that the random walk in the first part stops 
at v after exactly t steps, which is well understood in the classical random walk literature. Another 
advantage is that since the walk in the second part is on a self-avoiding path, the resulting random 
path in the original graph does not intersect with itself either, which makes our analysis easier. 

Finally, we give a new upper bound for QLSdN 1 ^ 2 ] 2 ) by showing an algorithm working better 
than the generic algorithms. Together with the lower bounds in Theorem[21 this implies that Local 
Search on grids exhibits different properties at low dimensions. 

Theorem 3 QLS{[N 1 / 2 ] 2 ) = 0(N l / A {\og\ogN) 2 ) 

Both our lower and upper bound techniques can be used on more general graphs. The proof 
of Theorem ^ and [21 generalizes easily to show lower bounds for Local Search on product graphs. 
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The technique used in the Theorem [3] can be naturally used on the general graph G that "expands 
slowly". See Section [S] for more detailed discussions. 

Other related results. There were two unpublished results about RLS^N 1 / 2 } 2 ) and QLS({Q, 1}™). 
It is mentioned in [2] that Ambainis showed QLS({0, 1}™) = J7(2"/ 3 /n°^), and it is mentioned in 
|2D] that Verhoeven showed RLS^N 1 / 2 ] 2 ) = Q.{N l l 2 - s ) f or any constant 8 > 0. 



2 Preliminaries and notations 

We use [M] to denote the set {1,2, ...,M}. We define the sign function to be sign(z) = 1 if 
z > 0, —1 if z < and if z = 0. For an n-bit binary string x — xo...x„-i € {0, l} n , let 
x^' = XQ...Xi-\(\ — Xi)xi+i...x n -i be the string obtained by flipping the coordinate i. 

A path X in a graph G — (V,E) is a sequence t?/) of vertices such that for any pair 

(vi,Vi+i) of vertices, either vi = Vi+\ or (vi,Vi + i) 6 £\ We use set(X) to denote the set of distinct 
vertices on path X. 

The (k, l)-hypercube is a special graph whose vertex set is V = [fc] and whose edge set is 
E = {(u,v) : 3i G [/], s.£. \ui — Vi\ — 1, and Uj = Vj, Vj ^ i}. Sometimes we abuse the notation by 
using [k] 1 to denote Gk,i- Note that both the Boolean hypercube and the constant dimension grid 
are special hypercubes. 3 

In an TV-vertex graph G = (V,E), a Hamilton path is a path X = (vi, v\y\) such that 
(vi,Vi+i) E E for any i £ [iV — 1] and set(X) = V. It is easy to check by induction that every 
hypercube [k] has a Hamilton path. Actually for I = 1, [k] has a Hamilton path (1, ...,£;). Now 
suppose [k] has a Hamilton path P, then a Hamilton path for [fc]' +1 can be constructed as follows, 
first fix the last coordinate to be 1 and go through P, then change the last coordinate to be 2 and 
go through P in the reverse order, and change the last coordinate to be 3 and go through P, and 
so on. For each (k, I), let HamPathk,i — (ui,...,Ujv) be the Hamilton path constructed as above, 
and we define the successor function Hk,i(vi) = Vi+i for i E [N — 1], 

We use i?2(/) and Q%{f) to denote the double-sided error random and quantum query complex- 
ities of function /. For more details on query models and query complexities, we refer to jlllj as an 
excellent survey. 



2.1 One quantum adversary method and the relational adversary method 

We describe the quantum adversary method proposed in |22j . The definition and theorem given 
here are a little more general than the original ones, but the proof remains unchanged. 

Definition 1 Let F : I N — > [M] be an N-variate function. Let R C L N x / be a relation such that 
F{x) ^ F(y) for any (x, y) € R. A weight scheme consists of three weight functions w(x, y) > 0, 
u(x, y, i) > and v(x, y, i) > satisfying u(x, y, i)v(x, y, i) > w 2 (x, y) for all (x, y) € R and i £ [N] 
with Xi 7^ iji . We further put 

w x = w ( x >v')i w v= ^2 w(x',y) (1) 

y' :(x,y')GR x' :(x' ,y)dzR 

u x ,i= ^2 u(x,y',i), v v ^= ^2 v{x',y,i). (2) 

j/':(x,j/')Gi?,Xi/j/i a;':(x',y)eJi,x<^j/i 

Theorem 4 [Zhang, |22| ] For any F, R and any weight scheme w,u,v as in Definition^ we have 



Q 2 (F) = fi( min (3) 

(x,y)£R,i£[N],x i9 iy, \j U x ,iVy yi 

In |2j , Aaronson gives a nice technique to get a lower bound for randomized query complexity. 
We restate it using a similar language of Theorem 0] 



Here we identify the Boolean hypercube {0, 1}" and G2,n since they are isomorphic. 
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Theorem 5 [Aaronson, Let F : I — > [M] be an N-variate function. Let R C I N x I N be a 
relation such that F(x) ^ F(y) for any (x,y) € i?. For any weight function w : R — ► K + , we /iawe 

R 2 (F) = fl( min max {^-,^L}) (4) 

w/iere 

w x ,j = w{x,y'), Wy,i= ^2 W [ X '->V)- ( 5 ) 

Note that we can think of Theorem [3] as also having a weight scheme, which requires that 
it(x, y, i) = y, i) — w(x, y). This simple observation will be used in the proof of Theoremnand 

m 

3 Lower bounds for Local Search on the Boolean Hypercube 

The proof of Theorem ^ uses the following lemma. Consider that we put t balls randomly into 
m bins one by one. The j-th ball goes into the ij-th bin. Denote by ni the total number of 
balls in the i-th bin. We write rij = bi if 6,; = mod 2. We say that (£i,...,if) generates the 
parity sequence (b±, ...,b m ), or simply [i\,...,it] generates (b±, ...,b m ), if Hi = for all i £ [m]. For 
b\...b m G {0, l} m , denote by jjW[6i, 6 m ] the probability that n; = 6 i; Vi S [m]. We may also 
require that the first ball is not put in the bin i* for some i* € [m]. We use p\» [bi, 6 m ] to denote 
the probability that rij = 6,, Vi € [m], under the condition that the first ball is not put in the bin 
i*. Let pf = max6 li ....b m pf [b±, b m ] and =ma,Xb 1 ,...,b m Pit [bi,---,b m ]. The following bounds 
on pfj are rather loose but sufficient for our purpose. 

Lemma 6 For any i* £ [m], we have 

{0(m~ r*/ 2 l) if t < 10 

0(m- 5 ) if 10 < i < m 2 (6) 

0(2- m ) if t>m 2 

The proof of the lemma is in Appendix A. Now we are ready to prove Theorem ^ 

Proof (of Theorem ^) We decompose the whole hypercube {0,1}™ into two spaces V w and V°. 
The first space V w is an m-dimensional hypercube {0, l} m , where m, a fixed value only depending 
on d, will be given later. The second space V c is an (n — m)-dimensional hypercube {0, l} n ~ m . 
Obviously, {0,1}™ = V w <g> V c , and each vertex x = XQ...x n -\ in {0,1}" can be decomposed as 
x = x w ® x c where x w = Xo—x m -i £ V w and x c — x m —X n -i G V c - We shall use the two spaces in 
the following way. In V w we perform a random walk; in V c we set a "clock" , recording how many 
steps the random walk in V w has gone. 

Consider the paths X = (2:0,0, ^o,ii ^1,0) x i,U •••> XTfi,XT,i) where T = 2™ _m — 1, that satisfies 
the following descriptions. 

1. The starting point xo.o = Xq ® %o o, where Xq is any fixed point in V w , say 00. ..0, and Xq 
is the first vertex in the fixed Hamilton path HamPath2, n -m of V c . 

2. For each t £ {0, ...,T}, 

(a) x t ,i = (x? )W®xt , where if £ {0, to- 1}. That is, we randomly choose a coordinate 
if of x™ and flip it. 

(b) Xt+ifl — xfi <g> H2 >n -m(xt i)' That is, we let the clock "ticks" once. 

Let the set P contain all such paths X's, then we define a problem Path p : given a path IeP. 
find the end point xt,i- We are allowed to access X by querying an oracle O whether a point 
x £ set(X) and getting the Yes/No answer. Note that an input of PATHp is actually a Boolean 
function g : {0, 1}™ — + {0, 1}, with g(x) = 1 if and only if a; € set(X). So strictly speaking, an 
input should be specified as set(X) rather than X, because in general, it is possible that X ^ Y 
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but set(X) = set(Y). For our problem, however, it is easy to check that for any 1,7 e P, we 
have X = Y set(X) = set(Y). (Actually, if X ^ Y, suppose the first diverging place is k, i.e. 
x k .o — 2/fc.0j but Xk.i 7^ Uk,i- Then X will never pass y k> \ because the clock immediately ticks and 
the time always advances forward. Thus set(X) ^ set(Y).) Therefore in what follows, we shall use 
X, Y... to specify inputs. 

The following claim says that the PATHp problem is no harder than the Local Search. 

Claim 1 i? 2 (PATH P ) < 2RLS({0,l} n ), Q 2 (Path p ) < 2QLS({0, l} n ). 

Proof For any path X £ P, we define a function fx essentially in the same way as Aaronson did 
in 2 : for each v $ X, fx(v) = 5(v,Xofi) + 2T, where S(u,v) is the Hamming distance between 
u, v € {0, 1}™; for each x t .b & set(X), fx(xt,b) = 2(T — t) — b. It is easy to check that the only local 
minimum point is xt,i- 

Suppose we have an Q-query randomized or quantum algorithm A for Local Search, we shall give 
a 2Q algorithm for PATHp. Given an oracle O and an input X of the Path problem, we run A to 
find the local minimum point of fx, which is also the end point of X. Whenever A needs to make a 
query on v to get fx(V), it asks O whether v e set(X). If v £ set(X), then fx(v) — S(v, Xo,o) + 2T; 
otherwise, v — xt }b for some t and b (note that for a given Xt, b , t is fixed and known). If t = 0, 
then fx(v) — 2T if v = xq.o and fx{v) — 2T — 1 otherwise. If t > 0, then we ask O whether 
v w Cg) H2n(v c ) G set(X). (H^^v) gives the predecessor of v in the fixed Hamilton path.) If yes, 
then v = Xtfl and thus fx(v) = 2(T — f); if no, then v = Xt t i and fx(v) — 2(T — t) — 1. Therefore, 
at most 2 queries on O can simulate one query on /, so we have a 2Q algorithm for PATHp. □ 

(Continue the proof of Theorem^) By the claim, it is sufficient to prove lower bounds for PATHp. 
We define a relation Rp of paths as follows. 

Rp= {(X, Y):X = (10,0, ^0,1) ...,x T ,a,XT,i)€ p > y = (yo,Oj2/o,ij — , Vt,o, Vt,i)€ p ,%t,i ^ Vt,i} (7) 

We then choose the weight functions. Recall that for a path X, if is the coordinate flipped at 
time t. For any (X, Y) E Rp, we write X A Y = k if ig = *o> ■••> = but *fe 7^ *fe- Let 

w(X,Y) = 1/\{Z e P : ZA X = k}\, (8) 

Now let us calculate Wx- By definition, wx = J2y'-(x Y')eR P w ^^'^ ^ e S rou P those Y' that 
diverge from X at the same place. Then 

T 

fe=0 Y':(X,Y>)eR,p,X/\Y> = k 

T 1 

= ^ S \{ZeP:ZAX = k}\ (10) 

T 

= ^Pr^ eP [^ 1 ^ : r T)1 |y / AX = fc] (11) 

fc=0 

By definition, if Y' A X = T, then y' T 1 Xt,i for sure. If fc < T, note that for those Y' that 
y' A X = k, yip 1 = xt,i if and only if (i v k , ...,i T ) generates the same parity sequence (b±, ...,b m ) 
as (i%,...,i?t) does. Thus Vty^pWti + x T , 1 \Y'AX = k] = 1 - p { £~ k+1) [61, b m ] = 1 - o(l) by 

' k 

mmfm \T 1 ( T /ill") 

Lemma|6l It follows that wx — ^2 k =o 0- ~ t^ 1 ' '"' ^m]) + 1 = T — o(T). Similarly, we have 

also w Y = T-o(T). 

Now we define u(X,Y,i) and v(X, Y, i), where i is a point Xjj £ set(X) — set(Y) or 6 
set(y) - set(X). 

u(X,Y, Xj , b ) = a ktjfi w{X,Y), u{X,Y,y j>b ) = b kJtb w(X,Y), (12) 
v{X,Y,x j}b ) = b kljlb w{X,Y), v(X,Y,y jtb ) = a kij , b w(X,Y). (13) 
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where cikj, b bkj. b — 1, and the values of dk,j, b and bkj, b will given later. We now calculate Ux,i and 
u^i for i = xj.b £ set(X) — set(Y) ; the other case i — yj^ is just symmetric. Note that since 
Xjfi € sei(X) — set(Y), we have fc < j — 1 if 6 = and k < j if 6 = 1. 

Mx,^, „ = E X! ak,j,bw{X, Y') 

k=0 Y':(X,Y')eR, X/\Y'=k, x jib $set(Y') 
j+b-1 _ j+6-1 

< E X! ak,j,bw{X, Y') = ^2 a k,j,b 

fc=0 Y'GP:XAl"=fc fc=0 

The computation for VY, Xjtb is a little more complicated. By definition, 

j+b-l 

v Y.x , b = E E b k j,bw{X',Y) 

k=0 X':(X',Y)ER, X'AY=k, x ]ib eset(X') 
j+b-1 

< E E 6 fcJ , b ™(x',y) 

fc=0 X'eP:X'/\Y=k, Xj , b eset(X') 

j+b-1 

= b kt j,bP*x>Mxj,b£set{X')\X' f\Y = k] 

k=0 

Note that because of the clock, Xj ib £ set(X') if and only if Xj, b = x'^ h , for some b' £ {0, 1}. And 
actually 6 = 6', because otherwise a;^ and have different parities of number of l's. Therefore, 

PT X ,[x jtb € set(X')\X' AY = k] = Pr x ,[x^ b = x' ]b \X' A Y = k] = pg _fc+6) [6i, ...,6 m ] < p^ k+b \ 

where (6i, ...,6 m ) is the parity sequence generated by if, ...,ij +h _ 1 . So 



(14) 
(15) 

(16) 
(17) 
(18) 



j+b-i 



j—m 1 



vy, Xj , b < E ^^ ( r fc+b) = o( E & ^/2 m + E w™ 5 + E ^/™ ro '- fe+6)/21 ) 



fc=0 



fc=0 



E 

k—j — m 2 -\-b 



E 

fc=j+6-10 



(19) 



Now for the randomized lower bound purpose, we pick m = [(n + log 2 n)/2j , <Xfc,j,6 = 6fc,.j,6 = 1- 
Then T = 2"- m - 1 = 9(2 n / 2 / \/n), = T ~° (T) > 1 - o(l), and 



joy 



n 



T - o(T) 



- m 2 /m 5 + X^t=i 1/™* 



2"/ 2 /y^ 



tt(V^2™ /2 ). (20) 



It is easy to check using the same calculations that for any y^ b £ set(Y) — set(X), 
r2(v / «2"/ 2 ), and y WY > 1 — o(l). Therefore, in either case (i = Xj tb or i = we have 



WX 



• y j,b 



RLS({0, l} n ) = max{ — , — } = ft(\/^2"/ 2 ) 

Ux,i Vy,% 

For the quantum lower bound, we pick m = [(2n — logn)/3j , and 



(21) 



a k,j,b 



m 



rn 



-r0-fe+6)/21/2 if j_ fc + & <10 



' m \(j-k+b) m/2 if? _ fc + 6<10 



-5/2 



2~ m/2 



if 10 < j - fc + 6 < to 2 , 6fe,j,6 = < 
if j - fc + 6 > to 2 



m 



5/2 



if 10 < j - k + 6 < m 2 
2 m / 2 if j - fc + 6 > to 2 

(22) 

Clearly a fc j b b k jb = l holds. Note that T = 2"- m - 1 = 6(2™/ 3 n 2 / 3 ). Thus w x = w Y = O(T) = 
Q( 2 «/3 n 2/3^ an( j 



j+b-1 j-m +6-1 j+6-11 

< E = E 2 ~ m/2 + E ™~ 

fc=0 fc=0 fc=j-m 2 +6 



j+b-1 

5 / 2 + ^ m- 

fe=j+6-10 



rCj-fc+6)/21/2 = O(v^) 

(23) 
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j-m 2 +b-l 3+6-II j+b-1 

VY,* jib <0( ]T 2 m / 2 /2 m + ]T rn 5 / 2 /m 5 + ]T m rCi-*-i)/31/2 /2 rtf-*-i)/21) = {^) 



k=0 k=j-m 2 +b k=j+b-W 



It is easy to check that the above inequalities all hold for the symmetric case of yj t b, so 



(24) 



□ 



4 Lower bounds for Local Search on the constant dimen- 
sional grid 

To simplify notations, we let n — N 1 ^ . For x = xq.-.x^i in [n] d , let x^ =l = Xo--.Xk-ilxk+i---Xd-i, 
and x ( fc ) = ( fc ' +l = x ...Xk-i(xk + i)xk+i—%d-t, where i satisfies Xk + i G [n]. Also let x^'~ = 

j.(i)=max{ii- 1,1} anc J 2;W>+ — j.(*)=min{!C4+l,n} 

4.1 1-dimensional short walk 

We will use random walk on an n-point line, where a particle is initially put at point i G {1, n}, 
and in each step the particle moves either to max{l, i — 1} or to min{n, i + 1} with equal probability. 
That is, the particle randomly choose to move left or right, but if it is currently at the left (or right) 
end and still wants to move left (or right), then it stands still. We refer to it as short walk. Let p-* 
denote the probability that the particle starting from point i stops at point j after exact t steps of 
the walk. Obviously, we have maXjjPy = 1 if t = 0. For t > 1, the following proposition gives a 
good estimate on maxy pr) . 
Proposition 7 For any t > 1, 

max^-/° (lM) lf l - n2 (26) 
"w^'" ~\0(l/n) t>n 2 (26) 

The proof of the proposition is in Appendix B. 

4.2 Weaker lower bounds 

We shall first show a weaker result in this section, then we improve it in section l431 As in the proof 
of Theorem^ we decompose the space [n} d into two parts V W ®V C , where V w = [n] m and V c = [n] c . 
Each vertex x — XQ...Xd-i in [n] d can be decomposed as x — x w (E> x c where x w — XQ...x m -i G V w 
and x c — x m ...Xd-i G V c . Consider the paths X — (#o,Oj &o,i) &i,0j#i,i) ••• ) #T,o> x T t i), where 
T = n d ~ rn — 1, satisfying the following description. 

1. The starting point 2o,o = ^oo ® x o 0' where an coordinates of \n/2\ , and Xq is the 
first vertex in the fixed Hamilton path HamPath n ^-m of V c . 

2. For each t G {0, ...,T}, 

/ \ _ r ft mod ml,+ ft mod m),— 

(a) a; t ,i G {x| )0 ,a^ }. 

(b) xt+1,0 = xf A (8 iT^i). 

Let P contain all such paths X's, then we define the PATHp problem in the same way as in 
the proof of Theorem^] and it is easy to show that i? 2 (PATHp) < 2RLS[[n] d ) and Q 2 (PATHp) < 
2QLS([n] d ). We write X A Y = k if x ,o = Vo,o, x ,i = yo.i, ■-, Xk,o = Vkfi but x k ,i ^ Uk,i- 
We then define Rp and all weight functions w,u,v in the same form as those in the proof of 
Theorem [T] (i.e. Q © C2J 03 ) ■ For two points zx,z 2 G V w , define Zj z 2 to be the event 
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that a random walk starting at Z\ stops at z 2 after exact t steps, performing one step of short 
walk in dimension ((I + s — 1) mod to) in the s-th step (s G [t]). By Proposition \7\ we know that 
Pr[zi ~*\ z 2 ] = Q( ^J m - ) = °(tH if 1 - 1 - m " 2 ' and Pr t Zl Z2 1 = ^(VO if * > mn2 - 
By some calculations similar to those in the proof of Theorem ^ we have wx — wy = T — o(T), 
ux,x Jtb < Lfcto" 1 a k,j,b, and v Y , Xj , b < Li-to" 1 & fe,i,6 Pr X' fe.ft G sei(X')|X' A F = fc]. Note that 
Xj.b € sei(X') <^> Xj.f, = a;^ b again due to the clock and the parity. Also note that if X' A Y = k, 

then x jtb = x' jb — >jlt+b m i d m x 7,b- Therefore, 

vy, X] , < ?+ f b^Vv^ ^f_flri d m *lb] (27) 

fc=0 

(j-mn 2 +b-l , j+b-2 \ 

v ^+ y t Kj ' h +b j+b - ltjb \ (28) 

Now for the randomized lower bound purpose, we take dkj.b — &fe,j,6 = 1- Then Wx — = 0(1) , 

and uy,^ = O + YT=i i ~ m/2 + l) =0 (n d - 2m + £™f *" m/2 + l)- When d > 4 we pick 
m = [d/2] > 2, then Wy ja . = 0(n d - 2m ) + 0(1) and = Q(n^). Therefore 

^([^) = ^ 2 (PATH p)) ^(max { ^,^- } ) = j^;L, :" = ^L 1 < 29 > 

ii^j^ "Yi^.t IQ(iV2 2d) ifd = 2d' + l 

For d = 4 and 3, we let m = 2 and get i?LS'([n] 4 ) = Q{n 2 /logn) = fl^^/logN) and RLS([n] 3 ) = 
f2(n) = ^(TV 1 / 3 ). For <i = 2, we let m = 1 and note that now the walk has only n long, so wy — &{n), 
vy> 3 , 6 = 0(\Zn)i and so #£S(N 2 ) = fi(Vri) = ^(iV 1 / 4 ). 
For the quantum lower bounds, take 

1 i£j-k + b=l ( 1 if j - fc + 6 = 1 

afe,j,b = "( (j - k + b - l)-™/4 jf i < j-k + b<mn 2 b k ,j,b = I (j - k + b - l) m / 4 if 1 < j - k + b < ran 2 
n~ m l 2 if j — k + b>mn 2 [n m / 2 if j - k + b > mn 2 

(30) 

Then u x , Xj , b = v Y , Xj b = O (Tn- m l 2 + Y^ti ^ m/4 ) > and 



QLS([n] d ) = fi(Q 2 (PATH P )) = n( / WXW ) = n — — - 2 (31) 

If d > 6, then we let m be the integer closest to 2d/3, thus to > 4. We get 

(n(N^) ifd = 3d' 

QLS{[n] d ) = io(ATi-^) ifd = 3d' + l. (32) 
[fi(JV^-ra) ifd = 3d' + 2 

For d = 6, let m = 4 and we have QLS([n} 6 ) = VL{n 2 / logn) = ^(iV 1 / 3 / logJV). For d = 5,4, 3, we let 
to = d - 2 and then w Y = 6(n 2 ), = 0(n 3 - d ^ 2 ) and gLS'([n] d ) = VL^' 2 - 1 ) = n{N 1 / 2 ~ 1 / d ). 

For d = 2, let to = 1 and QLS([n} 2 ) = h(^) = ^(n 1 / 4 ) = fi^ 1 / 8 ). 



4.3 Improvement 

One weakness of the above proof is the integer constraint of the dimension m. We now show a 
way to avoid the problem. The idea is to partition the grid into many blocks, and different blocks 
represent different time slots. 

For any fixed r, where r will be given later, let a — \n r \ , (3 — [n 1_r J and n' = a/3. We now 
consider the slightly smaller grid [n'] d . Let V\ be the set {xo...Xd-2 '■ x% E [n'}}. We cut V\ into 
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Figure 1: Illustration for changing a block in 2 dimensional grid 



(3 d ^ 1 parts, each of which is a small grid We refer to the set {xo...Xd-2Xd-i '■ (fcj — l)a < 

Xi < ki<3t, i = 0, d — 2, a < Xd-i < n' — a} as the block (fco, kd-2)- Note that (fco, kd-2) can 
be also viewed as a point in grid and there is a Hamilton path HamPathp^d-i in [/?] 

as defined in Section 2. We call the block (k' , k' d _ 2 ) the next block of the block (fco, kd-2) if 
(k' , k' d _ 2 ), viewed as the point in is the next point of (fco, kd-2) in HamPathp^d-i- 

Note that in HamPathp^-i, to go to the point next to (fco, kd-2), only one of fc , kd-2 changes 
by increasing or decreasing by 1. We call the the block (fco, ...,kd-2) the last block if (fco, ...,kd-2) 
is the last point in HamPathp t d-i- 

Now we define the random walk by describing how a particle may go from start to end. The 
path set is just all the possible paths the particle goes along. Intuitively, within one block, the last 
dimension d — 1 is the clock space as before. If we run out of it, we say we reach a boundary point 
at the current block, and we change to the next block via a path segment called block- changing 
segment. In what follows, we always use XQ...Xd-\ to denote the current position of the particle. 
Thus x = x + 1, for example, means the particle moves from x ...Xd-i to (x + l)x\...Xd-i. We 
also use (fco, fcd-2) to denote the current block which the particle is in. 

1. Initially x = ... = x d -2 = L a / 2 J, Xd-i = a + 1, fco = ••• = k d -2 = 1. 

2. for t = to (n' - 2a)f3 d - 1 - 1, 

Lct *' = L^jJ^ = <mod 

do either Xi — max{xi — 1, (fcj — l)a + 1} or X{ = minjxi + 1, fcjtt} randomly 
if t ^ k(n' — 2a) — 1 for some positive integer fc, 

Xd-l = Xd-l + (-1)*' 
else 

if the particle is not in the last block 

(Suppose the current block changes to the next block by increasing kj by b e { — 1, 1}) 

do Xd-i = Xd-i + {— 1)* for (a + 1 — Xj) times 

do Xj = xj +b for 2(a + 1 — Xj) — 1 times 

do Xd-i = Xd-i + {— 1)* +1 for (a + 1 — Xj) times 

/lji' — - kj ~\~ b 
else 

The particle stops and the random walk ends 



9 



It is easy to check that every boundary point has one unique block-changing segment, and 
different block-changing segments do not intersect. Thus the block-changing segments thread all 
the blocks to form a x [L] grid, where L — (n' — 2a)(3 d ~ 1 . Actually it is not hard to check 

that for the proof of the lower bound purpose, we can just think of the new path set as being 
defined in the [a] d_1 x [L] grid as in Section FOl with V w — and V c = [£]. 4 So we have 

w x =w Y = n(T), where T = L — 1 = Bin 1 ^- 1 ^ 1 -^). Also it holds u X ,x ilh < O^lto' 1 a kj,b) 
and v Y , Xj , b - V y2^k=o ~SP^t + 2^k=j~(d~i)a 2 +b (j-k+b-i)-^- 1 )/ 2 + °o+b-i,j,b ) ■ 

For randomized lower bound, a ktjfb = b kJjb = 1, v Y , X]b = OiT/a^ 1 + Y^Ji^ H**" 1 )/ 2 ). So 

w Y /vY, Xj , b = n (min | n ( rf - 1 )% ^^gg-^ |^ by noting that a = Q(rf) and f3 = O^). 

If d > 4, then let r = d/(2d - 2) and we get i?LS , ([n] d ) = ^(N 1 / 2 ). If d = 3, let r = 3/4 - 
log log n/ (4 log n), and we get RLS([n] 3 ) = fi(7V 1/2 /Vlog N). For d = 2, let r = 2/3 and we get 
RLS([n] 2 ) = n{N 1 / 3 ). 

For the quantum lower bounds, u, v are defined as in (jl2[) and l|13|l . where a,k,j,b is equal to 1 if 
j + b-k = l, equal to (J - k + b - i)-(<*-i)/4 ifi<j-fc + fe< (d- l)a 2 , and equal to a"^- 1 )/ 2 if 

j-fc + fe > (d-l)a 2 , and b k j, b = a^ b . Then QLS([n] d ) = fi (min jn^W 2 , ^u^^-V }) " 

Now if d > 6, then letting r = 2d/(3d - 3) and we get QLS([n] d ) = N 1 / 3 . If d = 5, then let 
r = 5/6- log log n/ (6 log n) and QLS([rc] 5 ) = (iV/logiV) 1/3 - For 2 < d < 5, we let r = d/(d + l), 
then QLS([n) d ) = jVV2-i/(<*+i). This completes the proof of Theorem 



5 The new upper bound on the 2-dimensional grid 

In [2], a quantum algorithm for Local Search on general graphs is given as follows. Do a random 
sampling over all the vertices, find the minimum /-value vertex v in them using the algorithm by 
Durr and Hoyer |12) based on Grover search |13) . If v is a local minimal vertex, then return v; 
otherwise we follow a decreasing path as follows. Find a neighbor of v with the smallest /-value, 
and continue this minimum-value-neighbor search process until getting to a local minimum vertex. 
We can see that this algorithm is actually along the generic algorithm approach (see Section 1), 
where the initial point is picked as the best one over some random samples. Here our idea is that 
after finding the minimum vertex of the sampled points, in stead of following the decreasing path 
of it, we start over within a smaller grid and do this recursively. 

Now we describe the algorithm, with some notations as follows. For a given function / : [n] 2 — > N, 
a vertex v £ [n] 2 and a set S C [n] 2 , let n(v,S) = \{u G S : f{u) < f(v)}\. A decreasing path of 
v 6 [n] 2 is a sequence of vertices vo = v,vi,...,Vk such that /(uj +1 ) = min v .( v .^ e E f(v) < /(i>i) for 
i = 0, k—1 and v k is a locally minimal vertex. We write /(it) < f(S) if f(u) < f(v) for all v S S. 
In particular, f(u) < /(0) is always true. For two vertices u = (ui,tt2),v = (t>i,i>2) € [n] 2 , the l\ 
distance is \u — v\\ = \ui — v\\ + |tta — «2|- I n the following algorithm, the asymptotical numbers at 
the end of some command lines are the numbers of quantum queries needed for the line. For those 
commands without any number, no query is needed. 

1. TO( ) = n, U(o) = [n] 2 ; 

2. i = 0; 

3. while (|m(j)| > y/n) do 

(a) Randomly pick (with replacement) [ 4 J^ ( ( ' ) ■ log vertices from U^y, 

(b) Search the sampled vertices for one with the minimal / value, using Durr and Hoyer's 
algorithm ,12 with the success probability at least 1 — 62. — 0(J log 77 l°g 7^) 

(c) if i = 0, then = 

else if /(«(*)) < /(W(i)), then = 
else = v {l y, 

4 See Appendix C for more explanations. 
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(d) for j = 1 to log i 

i. Randomly pick m G [ ['^(i) /4J , |~3m(j)/4~|], and let = {w G J7(j) : |w — = 
m}. 

ii. Test whether /(w(i+i)) < by Grover Search over Wu\ with the error proba- 
bility less than £4. — O(^m^) log ^) 

iii. If the answer is Yes, jump out of this for loop and go to Stepl3fl 

(e) Report Fail and terminate the whole algorithm. 

(f) m ( , i+1) = m, U {l+1) = {uE U(i) : \u - «(j+i)|i < m {i+1) }; 

(g) i = i + l; 

A. Follow a decreasing path of uu\ to get a locally minimum vertex. — 0(yfn) 

We now analyze the algorithm. Define the boundary B(S) of a set S C [n] 2 to be the set 
{s G S : 3t G [n] 2 '- 5, s.t |s - ^ = 1}. Therefore, B([n] 2 ) = 0. 

Step |23 -|3cl Denote by S the set of the |" 4 |^ ( '^ log sampled vertices in Step |3a] and let 
a = min tie s/(u). Then |{u G Ut{\ : f(v) < a}\ < m^/A with probability at least 1 — e\. Step 
13 bl can find a u achieving the minimum in the definition of a with probability at least 1 — 62- Put 
the two things together, we have n(vuy t/(j)) < mrsWi with probability at least 1 — ei — £2- Since 
< f(v(j)), we have n(u(j + i), < m(j)/4 with probability at least 1 — £1 — £2 too. 

Step I3dl - l3fl In the event n(it(j+i), < rna)/A, at most m^y/A possible m's in [m(i)] have 
"Bit; G s.i. < /(it(i + i))", because Vra G [m(j)], W(i) C f/(j), and different W(i)'s (due to 

different m) do not intersect. We say an m is good (and also Wu) is good) if < /(W^j)). 

Therefore, at least misy/A number of m's in [[m( i )/4j, |~3m(j)/4~|] are good. Since we pick m for 
log ^ times, we will get a good m with probability 1 — £3. The probability that all the Grover 
searches in Step 3(d)ii in the log ^ tries are correct is at least 1 — £4 log Putting the two things 
together, we know that if n(u^ i+ iyU^) < m^y/A, then with probability at least 1 — £3 — £4log^-, 
we can reach Step |H3 with a good m found. 

If both n(uu + i\,Uu\) < muy/A happens and we find a good m, then we have two conse- 
quences. The first one is that n(u( i+1 y i7( i+1 )) < m^ i+1 y Actually, since t/ (i+i) Q we have 
n(«( i+ i),?7(i + i)) < L m w/ 4 J < (Since n(u (i+1 ), U (i) ) is an integer, n(u (i+1) , f/ (i) ) < m (i) /Ais 

equivalent to n(u^ + iy Uu)) < |_ m (i)/4_|-) The second consequence is that /(u(i+i)) < f(B(U(i+iy)), 
provided that all the W(o), Wu-i) are good. To see this, we first show B(U( i+ xy) C B{U^))UW^y 
In fact, any s G S(J7( i+1 )) satisfies that s G and that 3t G [n] 2 — Uu + -n s.t. \s — t\i = 1. Recall 

that t7"(i+i) C t/(j), so if t G [n] 2 — f/(j), then s G B(U^y) by definition. Otherwise iG f/(i) — , and 
thus i G and |t — > ni( i+1 ) by the definition of Uu + -n. Noting that \s — uu + -n\i < m(j + i) 
since s G E/ft+i), and that \s— t\i = 1, we have \s— uu+u\i = m/j+i), which means s G Wuy Thus for 
all s G B(U( i+1 )), either s G B(U{i)) or s G W(j) holds, which implies B(U( i+1 y) C B(U(i)) U 
Continuing this process, we have B(Z7( i+1 j) C S(J7( )) U W( ) U — U = Wqq) U ... U W^y Now to 
prove < f(B(U( i+1 y)), it is enough to show that /(it ( , i+1) ) < f(Wi U ... U But this 

is easy by noting that f(u {l+1) ) < ... < and that /(u (j+1) ) < f[W(j)) for any j = 0, 

because we assume that all the W^'s are good. 

Putting all these together, we know that if all Wm), 1) are good, then with probability 

1 - (£1 + £ 2 + £3 + £4 log we have that W^) is good, n(w (i+1) , U( i+1 y) < m (i+1) and /(-u (i+1) ) < 
f{B(Ur i+ iy)). Denote by I the final value of i (when the algorithm jumps out of the while loop), and 
let £ = £i+£2+£3+£4 log i. Then by a simple induction, we know that with probability at least 1—Ie, 
we have that 1) all W(o), W(j_i) are good, 2) n(u(i),U(i)) < and 3) /(«(/)) < f(B(U(iy)). 
Note that 3) implies that any decreasing path of um cannot go out of the Uuy Together with 2), 
we have that any decreasing path of urn is no longer than turn < \/n, and thus following the path 
will get to a locally minimum vertex by no more than y/n queries. 

Since m( i+ i) < [3m(j)/4] (and m^j > ^/n), we have / < logn. Let e = 2 ^ - , £1 = £ 2 = £3 = 
e/4 = 0(1/ logn) and £4 = e/(4 log -) = (9(1/ logn log log n). Then the algorithm can finds a locally 
minimum vertex with the probability at least 1 — Ie = 1/2. 



As to the number of queries used, Stepl3bluses Q(y ~~~ l° g l° g l° g l° g n ^ — 0(^jm^ (log log n) 1 - 5 ) 
queries, because |f/(i)| < 2m 2 -^ (see Step|33l. Step|3H|uses 0(log log n^jm^ log(logn log logn)) = 
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0(y^m(j) (log log n) 2 ) queries. Finally, Step 0] uses 0(\/n) queries. Altogether, the total number of 
queries used is less than 0($2°1™ (log log n) 1 - 5 + y/m^) (log log n) 2 + y/n) = 0(y/n(log\ogn) 2 ) . 

6 Concluding Remarks: further improvements and general- 
izations 

The paper gives new lower bounds for Local Search problems. Some other random walk can be 
used to further improve the lower bound on low dimension grid cases. For example, by cutting 
the 2-dimensional grid into n 2 / 5 blocks (each of size n 4 / 5 x n 4 / 5 ) and using a random walk similar 
to Aaronson's in (but with some modifications to make the path self- avoiding), we can prove 
QLS([n] 2 ) = iV 1 / 5 / logiV. But this walk suffers from the fact that the "passing probability" is now 
n 4 / 5 times the "stopping probability". So it only works better at dimension 2. We put the further 
results in a complete version of the paper. 

The lower bound technique we use can be easily generalized to the Local Search on prod- 
uct graphs. Precisely, G = (V,E) is a product graph if G can be decomposed as G\ x G 2 = 
(Vi x V2, (Ei x h) U (h x E2)) where It — {(vi,vi) : u, € Vi} for i = 1,2. Some graphs, like hy- 
percubes, may have many ways of decomposition. For a fixed decomposition 2?, suppose we have a 
random walk W on graph Gi = (Vi,Ei) with transition probability {pij : i = j or (i,j) € E} and 
stationary distribution tt. Denote by pfj the probability that the random walk starting at i stops 
at j after t steps. Let p(') = maxy and n max = max ie y 1 n(i). We say the walk mixes at time 

to if p^ -* < 2TT max . Let pi = Ylt<t P^ an<1 ^!/ 2 = St<t s/jffi- Then under mild conditions, we 
have 

RLS(G) = 0(maxmin{ — , — }), QLS(G) = »(maxmin{ , — — }) (33) 

23 Kmax Pi v \J^max Pl/2 

where L is the length of the longest self-avoiding path in G2. 

Random walk has been widely studied as a sampling method for algorithms, where the key 
parameter is the mixing time. It is interesting that both Aaronson's 2 and this paper use random 
walk to give lower bounds. And we can see from 133fl that for lower bounds, we care not only about 
the mixing time of the random walk, but also about its behavior before mixing. 

The paper also gives a quantum upper bound on 2-dimensional grid Local Search. The technique 
naturally applies to the graph G that expands slowly: if for any vertex v and integer k, the number 
of vertices that v can reach within (and exactly by, resp.) k steps is at most c(k), (and r(k), resp), 
then 

RLS(G) = o(j2 (^+r(m (j) )) (log log dA , (34) 

QLS(G) = O (j2 [\f^^- + V r(m w)l ( lo ^°& d )^j . ( 35 ) 

where mm = d, the diameter of the graph, and mu-\ £ [m(j_i)/4, 3m(j_i)/4]. For 2-dimensional 
grid, we have c(k) = <d(k 2 ) and r(k) = 6(fc), so l|33|) gives the upper bound in Sectional 
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A Proof of Lemma [B] 

Recall that suppose the j-th ball is put into ij-th bin, and m = 1 means n, is odd, rii = means 
is even. 

Proof First, it is easy to see that for any 61, b m £ {0, 1} and any i* £ [m], it holds that 

p^[b 1 ,...,b m }<^ J p^[b 1 ,...,b m \ (36) 

Actually, 

p (t) [6i, ...,b m ] = Pr[zi = T]Pr[(ii, ...,i t ) generates (61, b m )\ii = i*] (37) 
+ Pr[«i 7^ i*]Pr[(ii, i t ) generates (61, b m )\ix ^ i*] (38) 

= -p^[h, ...h*-x, 1 - &<•, bi. +1 , ...,b m ] + "H—lpf)^, b m ] (39) 
m m 

>n^± p u [bu bm] (40) 

m 

So to prove the lemma, it is enough to show the same upper bound for p^[b\, b m ]. 

We start with several simple observations. First, we assume that t and have the same 

parity, because otherwise the probability is and the lemma holds trivially. Second, by the symme- 
try, any permutation of &i, ...,b m does not change p^ 1 [(61, ...,b m )]. Third, pO[(&i, ...,b m )] decreases 
if we replace two l's in 61, b m by two 0's. Precisely, if we have two biS being 1, say b\ = 62 = 1, 
then [(bi, ...,b m )] < p^[(0, 0, 63, 6 m )]. In fact, note that 

P W[(6 1 ,...,6 m )] = 4 E ;rr— r (41) 

= J_ y I ^ y (ni+n^i ( . 2) 



n 3 + ...+ra m < 



t \ K n 1 +n 2 =t-n 3 -...-n 7n 1 z 



,=6,- ,4=1,2 



where as usual, let 0! = 1. If 71,3 + ... + n m < t, then 



(n 1 +n 2 )l = y- (ni+ng)! 



ni+77.2— £— ri3 — — n TT1 "" "~ ni+77-2— t— ns — ... 

71^ = 1^=1,2 n i =0,i = l,2 



If n3 + •■■ + n m = then the only possible (^1,712) is (0,0), so 

y K+n 2 )! y^ (m+n 2 )! _ L 

^ 77 i ' 77 o ' Z—^ 77 -1 ' 77 o ' 



ni+77,2— t— — — n m ni-\-7i2—t — n3 — . . . 

n, = l.i=1.2 n„- =0,8=1,2 



Thus [(1, 1, 6 3 , b m )} < [(0, 0, 63, & m )]. 

By the observations, it is sufficient to prove the lemma for the case p^' [(0, 0)] if t is even, and 
for the case p^ [(1, 0, 0)] if t is odd. Note that if t is even, then 

m 

pW[(0,...,0)] =E Pr [*i =*]Pr[(»a,...,*t) generates (e,)] (45) 

i=l 

where ej is the m-long vector with only coordinate i being 1 and all other coordinates being 0. 
By the symmetry, p ( *- 1} [ei] = ... = p^ -13 [e m ], thus p w [(0, ...0)] = p^ -1 ^] = pO" 1 ) [1, 0, 0]. 
Therefore, it is enough to show the lemma for even t. 

We now express p^[0, 0] in two ways. One is to prove the first case (t < 10) in the lemma, 
and the other is for the second case (10 < t < m 2 ) and the third case (t > m?) in the lemma. 



14 



To avoid confusion, we write the number m of bins explicitly as subscript: Pm\b\ 1 .. .,&,„]. We 
consider which bin(s) the first two balls is put into. 

pW[0,...,0] =Pr[*i = i 2 ]p^[0,...,0] + Pr[ti ^ i 2 ]p£- 2 >[l, 1,0, -, 0] (46) 

= - P t 2) [0, -A + — P<t 2) [l, 1,0, ...,0] (47) 
m m 

r+ 2) 

To compute pin [1, 1,0, •••,0], we consider to put (t — 2) balls in m bins. By the analysis of the 
third observations above, we know that 

^- 2 )[0,...,0]-p(*- 2 )[l,l,0,...,0] (48) 
=Pr[ni=n 3 = > n 8 = 0,...,n m = 0] (49) 
=Pr[m = n 2 = 0]Pr[n 3 = 0, n m = 0|m = n 2 = 0] (50) 



m-2 



t-2 



pL 2 2 } [0,...,0] (51) 



Therefore, 



W[0,...,0]=^ 2 )[0,...,0]-^(^)" 2 P ^[0,...,0] (52) 

(2) 

Now using the above recursive formula and the base [0, ...,0] = 1/m, it is easy (but 

tedious) to prove by calculations that Pm[0, 0] = ((t — l)!!/m5)(l — o(l)) for even t < 10. This 
proves the first case in the lemma. 

For the rest two cases, consider the generating function (xi+...+x m )' = En , , n _ 4 ( )arj 

If a* G {-1, 1}, then (x! + ...ia = E„ 1+ ...+„ m=i („,,.!,„„) (- 1 ) l{<:Zi= " 1 ' n ^ 1}l - We sum it over 
all X\...x n G { — 1,1}™. Note that for those (ni,...,n TO ) that has some ni = 1, it holds due to the 
cancelation that ^2 Xl x g/_i i} ( — l)ll i:ai=_1 ' ni=:L ll = . On the other hand, if all n,-'s are even, 

then E» 1 ,...,„ me{ -ia}(- 1 3 l{<!X ' L " 1,niSl}l = 2m ' Thus we have Exi,...^ ra g{-l,l}( a: l + - + ^)' = 
2 m E«i+.. o +n„= t ( ni ,.!, n J- Therefore 

pW[o,..,o] = iy E f * ) ( 53 ) 



p 



m L \rii, ...,n m 

n 4 =o,ie[m] 



1 



^ (xi + ... +a; m )' (54) 



2 m m* 

ii,...,i m e{-i,i} 

i=0 v 7 i=0 v 7 v 7 

It follows that p^ [0, 0] decreases with t, and this proves the second case of the lemma with the 
help of the first case. And if t > m 2 /2, then 

1 / _ I 2 \ » -, / m 



2 m \ \ m 
This proves the third case of the lemma. □ 



i=i 



pW[0, ...,0] < — 2+ 1 - - E L- < 2 / 2 ™ + e ~™ = °( 1 / 2 " 1 ) ( 5fi ) 



B Proof of Proposition [7] 

Proof We consider two settings. One is as in the definition of the short walk, where we have only 
n points 0, ...,n— 1, and points and n — 1 arc two barriers 5 . Another is the same except that the 

5 Here we let the n points be 0, n — 1 instead of 1, n just to make the later calculation cleaner 
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barriers are removed, and we have infinite points in a line. For each t-bit binary string x — x\...xt, 
we use Pf and Qf to denote the two paths that starting at i and walk according to x in the two 
settings. Precisely, at step s, Qf goes left if x s = and goes right if x s = 1 . Pf goes in the same 
way except that it will stand still if the point is currently at left (or right) end and it still wants 
to go left (or right). If the end point of Pf is j, then we write i j. Let xff' P be the set 

of x G {0, 1}* s.t. i ->f' x 3, and P ut n [ ^' P = \x\f' P \. Then by definition, pf) = nf)' P '/2*. The 
notations i -^f' x xf)'® and nf)'® are similarly defined, with the corresponding P changed to 
Q. Note that nf)'® = ( t /2+(j-i)/2) ^ 3 ~ * an d * have the same parity, and otherwise. We now 

want to upper bound nf)' P in terms of nf)'® . 

For a path Pf , if at some step it is at point and wants to go left, we say it attempts to pass 
the left barrier. Similarly for the right barrier. We say a path is in the {a s ,b s } l s=1 category if it 
first attempts to pass the left barrier for a\ times, and then attempts to pass the right barrier for 
&i times, and so on. We call each round a stage s, which begins at the time that Pf attempts 
to pass the left barrier for the (<n + ... + a s _i + l)-th time, and ends right before the time that 
Pf attempts to pass the left barrier for the (ai + ... + a s + l)-th time. We also split each stage s 
into two halves, cutting at the time right before the path attempts to pass the right barrier for the 
(&! + ... + fe s _ 1 + l)-th time. Note that a\ may be 0, which means that the path first attempts to 
pass the right barrier. Also bi may be 0, which means the the last barrier the path attempts to pass 

is the left one. But all other dj, frj's are positive. Also note that in the case of I = 0, the path never 

(t) p 

attempts to pass either barrier. We partition X\-''' as 

X^ P = U ^ P [{a s ,b a }U\ (57) 

I, {a a ,b s }' a=1 

where X^' P [{a Sl b s } l s=1 ] contains those paths in the category {a s ,b s } l s=1 . Put nf)' P [{a s , & s }' s=1 ] = 

l4* ) ' P [{ a -^}i=i]l' thus ^ ),P = S i E K)6s}U ^? p [{a,,^}i=i]- 

Now consider the corresponding paths in X^' Q . The following observation relates Pf and Qf. 

Observation 1 For each x G Xj9' P [{a s , b s } l s=1 ], the following two properties hold. 

1. In the first half of stage s, the path Qf touches (from right) but does not cross the point 

2. In the second half of stage s, the path Qf touches (from left) but does not cross the point 

Ps = Tl - 1 + Yfr=l( b r - «r) 

3. The path Qf ends at 7 = j + E' s=1 (&s — a s ) 

We let Y^'^[{a s , f3 s } l s =i] contain those x G {0, 1}' satisfying the three conditions in the above 
observation, and denote by mfj'®[{a s , [3 s } l s=1 ] the size of the set Y^ yQ [{a s ,p s } l s=1 }. Thus the ob- 
servation says xf)' P [{a s , /3 s } l s =i] C Y^p' Q [{a s , [3 s } l s=1 ], and therefore we have nf^ ,P [{a s , b s } l s=1 ] < 
mfj'®[{a s , f3 s } l s=1 ]. Now for each x G Y^'®[{a s , f3 s } l s=1 ], if we change the condition 1 in the case 
s = 1 by allowing the path to cross the point ai, and let zf^'®[{a a , f3 s } l s=1 ] be the new set satisfying 

the new conditions, then mfJ> Q [{a Sl /3 s } l s=1 } = \Z%' Q [{a s , [3 s } l s=1 ]\ -\Z%' Q [ ai -l, U {a s , f3 s } l s=2 ]\. 
In other words, the set of paths touches (from right) but does not cross ct\ is the set of paths touches 
or crosses at\ minus the set of paths touches or crosses ct\ — 1. 

Now we calculate |Z^ ,( ^[{a s , /3 S }^ =1 ] | by the so-called reflection rule. Suppose the first time that 
Qf touches ct\ is t\. We reflect the first t\ part of the path Qf with respect to the point a\. Precisely, 
let y = (1 — xi)...(l — x tl )x tl +i...x t , then the paths Qf and Q% a t merge at time t\. And it is easy 

to check that it is a 1-1 correspondence between Z^'®[{a s , f3 s } l s=1 ] and Y^^ ir/ [[3i, {a s , /3 s }g =2 ], 

Here \/3i, {a s , /3 s } l a=2 ] is the set of paths starting at 2ct\ — i, satisfying (a) the condition 2 
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at the first stage, (b) both conditions 1 and 2 at the rest I — 1 stages, and (c) condition 3. So 

\Z^ Q [{a s ,(3 s } l s=1 }\ = \Y^;%^,{a s ,0 s } l s=2 ]\ = m^.^iMs, Ps} l s = 2 ] (58) 

= m^£-i,#i,{a.>ft}U] (59) 

= m^f-i.-y+aa [A + ax, K + ax, A + ai}U] (60) 

where (|59f) is due to the fact that «i = —ax, and (|60f) is because that the number of the paths does 
not change if we move all the paths right by a\. Similarly, we have 

\Z^' Q [ ai - l,0x,{a s ,l3 s } l s=2 ]\ = m 2 tf-2-i,-y[PuWs,P s } l s = 2 ] (61) 

= m^V^+aJA + ax,{a s + ax,0 s + ai} l s=2 ] (62) 

Therefore, 

n§' P [{aMU] < m^ Q [{a s ,0 s } l s=1 ] (63) 

= m^_ i)7 [A,{« s ,A}U] - mL*g -2-i, 7 [A,{a„/3 s }U] (64) 



-Oi — i,7+ai 



+ai,{a s +Oi, /3, + ai}Ua] (65) 



-ai — 2— z,7+ai 



[/3i + ai,{a s + ai,/3 s + ai}^ =2 ] (66) 



Now for any fixed I > 1, we consider those categories with ai > and b\ > 0. Other cases can 
handled similarly. Note that a s + a x = bi + Ylr=2(^r ~ a r) — Ps + a i = n — 1 + J2l=2(^r — a r) 
and 7 + ai = i + &i + X)r=2(^ — a » ) are a ^ functions of (pi, a 2 , b 2 , ft;, &;), not of a\ any more. 
Therefore, 

E n^ P [{a S: b s } l s=1 ] (67) 

Oi,i)i,...,o;,6;>0 

< Yl T,( m -^-i,i+adh+ a id*s + ai,Ps + ai} l s=2 \ (68) 

fci ,...,ai ,bi >0 ai>0 

- m { ^f_ 2 _ in+ai [Pi + a u {a s + a x ,p a + a x }U]) (69) 
= £ (m^ 7+ai D9i + oi,{a. + o 1> A + o 1 }i =a ] (70) 

&l,...,a ! ,6j>0 



1)1 



— 2— 2,7+ai 



[/3i +oi,{a a + oi > A + a 1 }i =a ]) (71) 



Note that due to the parity, only one of m_i® irf+ai [Pi+ai, {a s +ai, Ps+ai} l s = 2 ] and m^} 2 % a+ai [f3i + 
ai, {a s + ai, p s + ai}i =2 ] * s nonzero. So the summation of them two items is equal to the maximum 
of them. Now using the similar methods, i.e. reflecting with respect to points (n — 1 + bi) and 
(n + bi), moving the paths left by b\, and finally collapsing the telescope, we can get 



E m^ iil+ai [px+ax,{a s + ax,p s + ax} l s=2 ] (72) 
6i,...,O!,6i>0 

E max{m^ Q ii7+ai _ 6i [{a 8 +ai - b x ,p s +ai - &i}i =2 ], (73) 



02,62, ...,oi,6i>0 



m 2 ^ +1 , 7+ai _ 6l [{a s +ai-6i,^ s +ai- h} l s=2 }} (74) 



and 



E m®2% +ai [Pi + ax,{a s + ax,p s + ax} l s = 2 ] (75) 

61, ...,01,61 >o 

E maX { m 2n5+2, 7 +a 1 -f, 1 + a X ~ &X, Ps + Ol - 6l}i =2 ], (76) 

a 2 ,62,...,a!,6i>0 



2n+z+3,7+ai — 



[{o. + ai-6 1 ,A + a 1 -6i}i =2 ]} (77) 
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We continue this process, and finally it is 

J2 n^KAlU] <m ax { n V£ +h „ +n=i(aa _ bt) :h = 0,...,41-l} (78) 

ai,&i,...,aj,6j>0 

= max{4t% +htj -h = 0,...,4l-l} (79) 
= ng&j (80) 

< ( t , j-«-21n ) (81) 

\2 ' 2 / 

Thus 



M «> . '"V lo(£$) = o(S) if*>»- 

For other categories that a\ = or 6/ = 0, the same result can be proved similarly, and the I = 
is easy since n^'^ = 0(2*/V*)- Putting all things together, we get the result 



(t) (o(iM) if t<,. , 

Pij ~ 10(l/n) if / n 2 



for any i and j, which completes our proof. □ 



C Further explanations of the construction in Section 14.31 

In this section, we further explain the construction in Section l4.3l In particular, we shall make the 
claim more clear that we can think of the construction the same as a long grid [a] c! ~ 1 x [(nf— 2a)/3 d ~ 1 ]. 
Actually, what we care about is, as before, the probability that the random walk starting from a 
point x = x ...Xd-i passes another point x' — XQ...Xd-i after exactly t' — t steps. Here t is the time 
that the random path passes x and t' is the time that the path passes x' . Note that t is fixed and 
known by x itself; similarly for t' . Denote this probability by Pr [x — » x'] . Suppose x t — (ki — l)a+j/j 
and x\ = (kl - Xja + y'i for i G {0, d- 2}. 

We first consider the case that one of the two points, say x' is on a block-changing segment. Since 
different block-changing segments never intersect, a path passes x' if and only if the path passes 
the boundary point x" at the beginning of the block-changing segment that x' is in. Also note that 
the time that the path passes x" is also t' because the time does not elapse on the block-changing 
segment. So it holds that Pr[x — * x') = Pr[x — x"], and it is enough to consider the case that both 
x and x' are not in clock-changing segments. 

Now suppose both x and x' are not in clock-changing segments. In general, x and x' may 
be not in the same block , so going from x to x' needs to change blocks. Recall that to change 
from the block (fe , kd-2) to the next one, only one ki changes by increasing or decreasing by 1. 
Suppose that to go to x' from x, we change blocks for c times, by changing k^, ki 2 , ki c in turn. 
Let n,j = \{s £ [c] : i s = j}\. Note that to get to x' from x after t' — t steps, the coordinate j 
needs to be x'j after if — t steps for each coordinate j G {0, d — 2}. It is not hard to see that if 
a block-changing needs to change kj , then only the coordinate j gets reflected within the current 
block. That is, suppose the coordinate j is (kj — l)a + t/j before the block-changing, then it changes 
to (kj — l)a + a + 1 — yj after the block-changing. So if c = 1, then Pr[x — > x'] is equal to the 
probability that a random walk in starting from yo-..yd-2 stops at y'o---y'd-2 a ft er t' — t steps, 

where y" = y'j if j ^ i\ and y-' = (k i± — l)a + a + 1 — y'^. For general c, Pr[x — > x'] is equal to 
the probability that a random walk in starting from y ...yd-2 stops at y'o»-y'd_2 after t' — t 

steps, where y" = y'j if rij is even and y" — (kj — l)a + a + 1 — y'j if rij is odd. Note that the 
latter probability has nothing to do with the block-changing; it is just the same as we have a clock 
space \(n' — 2a)(3 d ~ 1 ] to record the random walk on Thus we can use Proposition[7|to upper 

bound this probability and further the proof of the lower bound. 
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